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Simulation codes often utilize finite-dimensional approximation resulting in numerical 
error. Some examples include 

® numerical methods utilizing grids and finite-dimensional basis functions, 

» particle methods using a finite number of particles. 

These same simulation codes also often contain sources of uncertainty, for 
example 

o uncertain parameters and fields associated with the imposition of initial and 
boundary data, 

d uncertain physical model parameters such as chemical reaction rates, mixture 
model parameters, material property parameters, etc. 


Remark: Another form of error amenable to the present analysis (but not considered 
here) is modeling error, e.g. approximate models of turbulence, chemical catalysis, 
and radiation. 
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Non-intrustive uncertainty quantification methods quantify the uncertainty of 
output quantities of interest (Qol) by performing simulation realizations for specific 
values of uncertain parameters. 
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Question: How does realization error effect moment statistics calculated using these 
non-intrusive methods? 


To address this question, we have constructed computable a pos?er/or/ error bounds 
for output Qol moment statistics such as expectation E[ ] and variance V[ ]. 


m = m pu) di , v[f] = (f(4) - E[f]f pii) di 


Preview Example: Uncertainty Calculation with Error Bounds 
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0 Wing-body CFD calculations using the Reynolds -averaged Navier-Stof^^^^^^^^' 
equations, 

o 2-equation turbulence model, 

o Flight Mach number uncertainty. Moo = Gaussian 3 (j(m = .9,a = .0225), 
o Hybrid Clenshaw-Curtis calculation of moment statistics. 
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Let a e R" denote a vector of N uncertain parameter associated with sources of 
uncertainty, f; a) a numerical realization in (x, f) e with uncertain 
parameters a, and u{x, t, a) the exact infinite-dimensional counterpart. 

Quantities of Interest (Qol). Let a) = J{Uj^{x, t, a); a); denote an output 
quantity of interest 

o Functionals such as space- time integrated forces and moments. 

<» Graphs of derived quantities such as pressure or temperature along a 
space -time curve. 

® Derived quantities from general space-time volume subsets. 


N on-intrusive uncertainty propagation. The non-intrusive propagation methods 

considered herein obtain estimates of Qol statistics and/or probability densities from 
M realization Qol outputs 

{J{Uh: 






Calculation of Moment Statistics via Quadrature 
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Let N denote the number of uncertainty (stochastic) dimensions 

® Dense tensorization methods, complexity 0{M!^u) 

9 Stochastic collocation, precision 2M^d - 1 , smooth integrands 

9 Multilevel Clenshaw-Curtis and Gauss- Patterson quadratures, 

Mid = ± 1 , precision 2 level + 1 , smooth integrands 

9 Hybrid Multi-level Clenshaw-Curtis and Adaptive Polynomial (HYGAP) 
quadrature, Barth (2011), piecewise smooth integrands 

® Sparse tensorization methods, complexity (9(A/P^ec/s/on^ 

9 Clenshaw-Curtis and Gauss- Patterson Sparse Grids, precision 2 level + 1 , 
smooth integrands 

d Multi-Level (M-L) sampling methods 

9 Multi-level random sampling for hyperbolic stochastic conservation laws 
(Mishra and Schwab (2009)), smooth and non-smooth integrands 
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An Error Bound for Moment Statistics with Realization Error - 
Preliminaries 
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Let /[/] denote the weighted definite integral 

l[f]= f f{Op{Od$. , P(|)>0 

and Qm/[/] denote an /W-point weighted numerical quadrature 

M 

/=i 


with weights Wj with evaluation points ^/. Finally, define numerical quadrature error 
denoted by i.e. 


= l[f] - OMl[f] • 
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Combined 
Error and 
Uncertainty 

Tim Barth 

Non- 

Intrustive 


An Error 
Bound on 
Statistics 

Numerical 

Results 


Let e = J{u) - J{u^) denote the Qol error. 

Expectation Error 

\E[J{u)] - QmE[J{u^)]\ < |QA^E[|e|]| + |EME[|e|]| + \RmE[J{u^)]\ 


Variance Error 

\V[J{u)]-QmVIJ{u,)]\ 


< 2((|QME[|e|2]| + |%[£[|e|2]]|) 

x{\QmV[J{ui,)]\ + \RmV[J{ui,)]\)) 

+ |Qm£^[|c|^]| + |/^M^[|c|^]| + \RM^['^{^h)]\ 


1 

2 


o Red terms can be made smaller by decreasing realization error, 4 , e. 
® Rm^[ ] ^nd RmV[ ] can be made smaller by increasing M, t M. 
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Adaptivity Framework Objective: Answer adaptivity query questions (approximately) 
without explicitly computing new realizations. 

♦ Estimate the effect of solving the given realizations more or less accurately by 
multiplying the Qol error at the /W realization quadrature points by a factor 
QjJ= 1 , . . . , /W, e.g. let e g [0, 1 

M 

QMf[|e|](e) = 

/=1 


♦ Estimate the effect of solving the numerical quadratures more or less accurately by 
exposing the dependence of the quadrature error on the parameter M. Let denote 
a proposed new quadrature parameter, estimate the expected decrease/increase in 
quadrature error, e.g. 

] , q=M^jM 

with f{q) the predicted quadrature error decrease/increase (derived later on). 




The Adaptivity Framework 


Combined 
Error and 
Uncertainty 

Tim Barth 

Non- 

Intrustive 


Expectation error formula with adaptivity parameters (e, q) 


E[J{u)] - QME[J(Uj^)]\{e, q) < |QME[|e|]|(e) + |^?M^[|e|]|(e, q) + \RME[J{u^)]\{q) 
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Scenarios 

o (Analysis) Calculate the accuracy of computed statistics. Set q = 1 , e/ = 1 . 

® (Error Balancing) Given realizations with error e, determine the value of 
q = M^/M that balances the error terms 

|QM£^[|e|]| = \RME[J{ui^)]{q)\ + |/=?a^E[|€|]|( 1 , q) 

For q > 1 , new realization must be performed. 

d (Error Balancing with Specified Error Levei) Specify a given level of error. 5, 
for Qol statistics, determine qand e such that 

5/2 = |C?M^[|e|]|(e) = |F?ME[J(u/i)](q)| + |F?ME[|e|]|(e, q) . 

If q > 1 . new realizations must be performed. If e/ < 1. then realization / must 
be solved more accurately. 
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Estimate the quadrature error, R^[ ] = l[ ] — ], arising from the calculation of 

statistics. 


» (dense and sparse quadratures) Exploit the node-nested structure of multi-level 
Clenshaw-Curtis and Gauss- Patterson quadrature. 

Q (multi-level sampling) Use the well-known quadrature error formula for 
Monte-Carlo sampling, oc (not discussed here). 




Multi-level Node-Nested Quadrature 

...,\ .^ 1 -. 
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Multi-level node-nested quadratures such as Clenshaw-Curtis and Gauss-Patterson 
quadrature provide a particularly advantageous framework for estimating moment 
statistics and estimating the underlying quadrature error. 

® Used in both dense and sparse tensorization, 

Q 2level + 1 polynomial precision, 

Q Data at level L reuses all data at level L - 1 . 

» Combined with piecewise polynomial approximation in the HYGAP algorithm 
(Barth ,201 1) for piecewise smooth integrands. 



Node-nested Olenshaw-Curtis (left) and Gauss-Patterson (right) quadrature point locations. 
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Integral in 


m = f , m 


Sparse quadrature formula (Smolyak) given a 1-D quadrature Q,- T ] 


= (e ® Q^-T+i I ’V] 


Error estimate for L-level Clenshaw-Curtis and Gauss-Patterson sparse quadrature in 
for integrands with r regularity, / g 




This error formula correctly reproduces the known 1-D error estimate for 
Clenshaw-Curtis and Gauss-Patterson quadrature 

■')[/] I = 0(2“''^) . 
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Error estimate for L-level sparse quadrature in for integrands with r regularity''. 

Estimate A (3- Level). Evaluate the quadrature error formula for 3 levels 
Q l[f] - q[''^/[/] = + h.o.t. 

© l[f] - Q[1V[^] = + h.o.t 

© l[f] - 0[iy[/] = + h.o.t. 


Ignoring higher-order terms, this is a system of 3 equations in the 3 unknowns 
{/[/], C, r} subject to regularity limits r g [fmin. Wl- 


^Shorthand notation: Rif[f] = 
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Estimate R (2-Level, r parameter). Evaluate the quadrature error formula for 2 levels 
assuming r is given 

@ l[f] - + h.o.t. 

@ l[f] - + h.o.t 


Explicitly solve for the quadrature error, 


l[f] - l[f] = Rf ^ /[/] = 


1 - 


id) 




with 


/Wr''log(‘^-^5(''+^y/Wi) 




log 




Liu, Gao, and Hesthaven (2011) claim that for smooth functions, "the error estimator 
has limited sensitivity to r and we have found that taking it to values of 2-4 generally 
yields excellent resultd' although their results do not provide convincing evidence of 
this. 


^ □ 
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Estimate E (3- Level). Estimate the quadrature error using a 3 -Level extrapolation 
formula 

log(/[/] - Qm,/[/]) = 2\og{QM,l[f] - ¥]) ~ log(QM,_, l[f] - Qm^.^/I/]) 

The regularity and constant, {r, C} can then estimated from 

0 l[f] - Q\^'>l[f] = C/Wf''(log(/Wj.))('^-'')(''+'') 

© /[/] - = C/W[yi(log(/Wi_i))(‘^-i)(^+i) 


This gives an explicit quadrature error formula for the Adaptivity Framework 

l , g = Mi, /Ml 

with 




Sparse Quadrature Error Estimate: Example Calculation 
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Clenshaw-Curtis Sparse Tensor Quadrature Estimates 


level 

quadrature 

true 

error 

EstA 

(r=5.5) 

EstR 

(r=4.0) 

EstR 

EstE 

3 

90.32273573 

58.3 

- 

- 

- 

- 

4 

37.60810455 

5.60 

- 

22.30 

37.22 

- 

5 

29.15399282 

-2.84 

3.2 

9.96E-1 

2.04 

1.35 

6 

31.77676498 

-2.23E-1 

-1.23 

-1.83E-1 

-4.17E-1 

8.13E-1 

7 

32.04908081 

4.91 E-2 

-1.03E-1 

-1.40 E-2 

-3.42E-2 

2.82 E-2 

8 

32.00861824 

8.61 E-3 

2.10E-1 

1 .72E-3 

4.38E-3 

6.01 E-3 

9 

32.00056238 

5.62E-4 

4.92E-3 

3.0 IE-4 

7.88E-4 

1.60 E-3 

10 

32.00001861 

1.86E-5 

3.0 IE-4 

1 .84E-5 

4.94E-5 

3.65E-5 

11 

32.00000033 

3.31 E-7 

1.02E-5 

5.78E-7 

1.57E-6 

6.15E-7 
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Software! 

Estimate for each realization /. Some viable 

techniques include 

o Richardson (2-level) and Aitken (3-level) extrapolation using space-time 
grid hierarchies, 

o Error evolution, see for example the work of Jeff Banks at LLNL, 

o Patch postprocessing techniques: Zienkiewicz-Zhu, Bramble-Schatz, 
Cockburn et. al, 

o A posteriori error estimation of functionals using dual / adjoint problems 
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Further Numerical Results 




A Model PDE Problem with Uncertainty and Error Specification 
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Deterministic Burgers' Problem: Viscosity- free Burgers’ equation 

^^u{x, t) + 0/2) = 0 , (X, f) e [0, 1] X [0, T] 


with sinusoidal initial data 


u{x, 0) = sin(27Tx) 


Phase Uncertain Burgers' Problem: Introduce a random variable, oj 

—u{x,t,u}) + —{u^{x,t,u})/2)=0 , (x,f,w) e[0, 1] X [0,7] xT? 

with phase uncertain initial data 

u(x,0,w) = sin(27r(x + g(w))) . 


Q g(uj) = sin(27Tw)/10 in present calculations, 

® Probability density, p(o;): Gaussiancr= 3 (p = 0,a = 0,07), 

o WE NO finite-volume (cubic polynomials) used in numerical calculations, 

® Clenshaw- Curtis Adaptive Polynomial quadrature used for statistics, M = 9, 

9 An exact solution is readily obtained, u(x, t,cj) = u(x + g(cj),t) for use in 
specifying the exact realization error. 






Burgers’ Equation with Phase Uncertain Initial Data 
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Burgers’ Equation with Phase Uncertain Initial Data 
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Figure : Exact and estimated error bounds for the variance statistic calculated using a 
Clenshaw-Curtis Adaptive Polynomial (HYGAP) approximation {M = 9) at 
Clenshaw-Curtis quadrature points for the Burgers’ equation problem with phase 
uncertain initial data at time t = .3S . 








Uncertainty Quantification of Functionals: Error Representation 
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Semilinear form B{ , ) and nonlinear J( ). 

Primal numerical problem: Find U/, g Vh such that 

S(Uh, Wft) = F(w/,) V w/, G V/,. 

Linearized auxiliary dual problem: Find g V such that 


B(w, (t>) = J(w) V w G V- 

J{U) - J(Uft) = J{u - u,,) 

= B(u-u/,,<t>) 

= B{U - 

= B{U, (t> 7r/,4>) B{Ut!, 

= F(0 - TT/,0) - B{Uh, - 7Trt4>), 


(mean value J) 

(dual problem) 

(Galerkin orthogonality) 
(mean value B) 

(primal problem) 


Final error representation formula: 


J(U) - J{Uti) = F{<^ - 



Error Estimation of Functionais: Muiti-Eiement Airfoii 
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Example: Euler equation flow past multi-element airfoil geometry. 
M = A, 5° AOA. 


lift coefficient 
(error representation) 

lift coefficient 
(error control) 

refinement 

level 

# elements 

equivalent uniform 
refinement 
# elements 

5.156 ± .147 

5.156 ± .346 

0 

5000 

5000 

5.275 ± .018 

5,275 ib .076 

1 

11000 

20000 

5.287 ib .006 

5.287 ib .024 

2 

18000 

80000 

5.291 ± .002 

5.291 ± .007 

3 

27000 

320000 




Error reduction during mesh adaptivity Adapted mesh (18000 elements) 


Uncertainty of Functionals: Multi-Element Airfoil 
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The inflow angle of attack (AOA) is then assumed uncertain with truncated 
Gaussian probability density, AOA = Gaussian 4 c,(m = 5°,<r = 1°). 

Let 

AmE[J{u)] = E[J{u)] - QmE[J{u,)] , Am V^[J(u)] = l/[J(u)] - Qm V[J{u,)] 

denote the errors in approximated expectation and variance, respectively 
using Clenshaw-Curtis quadrature (M=9). 


level 

# elements 


V[J{U,)] 

AME[J{Uh)] 

Am 

0 

5000 

5.145 

.01157 

.147 

.05619 

1 

11000 

5.274 

.01188 

.018 

.00462 

2 

18000 

5.286 

.01191 

.006 

.00240 

3 

32000 

5.292 

.01192 

.005 

.00148 


Table : Approximated statistics and error bounds for the aerodynamic lift coefficient 
functional. Tabulated are the computed estimates of expectation and variance 
together with error bounds. 






Example Calculation: ONERA M6 Wing 
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Software! 

o Compressible Navier-Stokes CFD calculation, 
o 2-equation turbulence model, 

9 Inflow Mach number uncertainty, Mao = Gaussianscrfm = ,84, a = .02) 

9 Angle of Attack uncertainty, AOA — Gaussianaafm = 3.06, = .075) 
o Hybrid Clenshaw-Curtis Adaptive Polynomial quadrature (M=9 x 9). 



expectation(density) 


log.,g variance{density) 


Ongoing Work - Beyond Moment Statistics 
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• Moment statistics have a limited value whenever the output PDF departs strongly 
from a normal distribution. 


.OJ -0.6 
u 
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PDF and Quantiles at span=.65 (left) 


Bi-modal PDF at x=.705 (right) 


Ongoing work: 

d Calculation of non-moment statistics, e.g. PDFs, quantiles, etc. 
® Error bounds for non-moment statistics. 
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Concluding Remarks 
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Quantifying the effect of realization error in the calculation of output moment 
statistics is a novel new capability not found elsewhere. 


The Adaptivity Framework and software API opens exciting new possibilities 
in adaptive CFD calculations. 


Moving beyond moment statistics towards the estimation of error bounds for 
more general statistical measures and PDFs is a vitally important capability 
that must be provided in order that UQ is genuinely useful to engineers. 


